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BACKGROUND OF THE INVENTION 

1. Field. of the Invention 

The present invention relates to a digital still camera 
10 with a flash device. 

2 . Background Arts 



function to correct the color balance of an image taken under 
15 various light sources. For example, since a main subject 
illuminated by flashlight even under illumination of an 
artificial light source, a taken image is usually subject to 
color balance correction by use of a prescribed adjustment value 
for the flashlight. 
20 However, when available light, such as illumination 

light from the artificial light source, is strong or when the 
flashlight is weak, the main subject is influenced by available 
light. As a result, the color balance of the taken image becomes 
undesirable . 

25 In order to obtain the image with desirable white balance, 

an attempt has made to determine a correct adjustment value for 
white balance correction by obtaining the ratio of the 
flashlight to available light illuminated on the main subject. 



30 to obtain much information, such as the distance between the 



A digital still camera has a white balance adjustment 



In order to calculate the ratio, however, it is necessary 
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digital still camera and the main subject, the position of the 
main subject, brightness of the main subject, the amount of the 
flashlight, and the like. A digital still camera with sensors 
to obtain such information is very expensive. 
5 Some digital still camera sets the adjustment value such 

that the corrected value is slightly smaller than that in 
photography without the flashlight. In that case, however, 
since such adjustment value is not proper to correct the white 
balance, the main subject in the taken image tends to have 

10 undesirable color. 

For the purpose of solving the above problem, Japanese 
Patent Laid-Open Publication No. 11-298908 describes an image 
processing method in which a subject exposure with the 
flashlight and a background exposure with the available light 

15 are carried out in a single photography. In the subject exposure, 
the digital camera emits flashlight to illuminate the main 
subject with the correct brightness. The white balance of the 
subject image is adjusted by the adjustment value for the 
flashlight. In the background exposure, an exposure is carried 

20 out with available light , and the white balance of the background 
image is adjusted by the adjustment value for available light. 
Then, both images are synthesized to obtain a composite image 
in which the white balance of the main subject and the background 
are properly adjusted. 

25 However, in the above image processing method, it is 

presumed that the main subject is extremely dark compared to 
the background. When brightness of the main subject is not 
largely different from brightness of the background, it is 
difficult to remove an influence of available light on the main 

30 subject. Moreover, the main subject in the taken image tends 
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to be overexposed because of the flashlight and available light 
illuminated on the main subject. Accordingly, the image 
processing method is not applicable to indoor photography. 
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SUMMARY OF THE INVENTION 
An object of the present invention is to provide a digital 
still camera which enables proper white balance correction of 
the subject image and the background image under various 
10 photography conditions . 

To achieve the above object , an exposure value in exposing 
a main subject is determined to obtain an underexposure value 
by two steps or more, compared to that in the background 
exposure . 

15 When carrying out a first exposure without a flashlight 

and a second exposure with the flashlight, imaging conditions 
in the first exposure are initially determined to obtain proper 
exposure amount according to measured subject brightness. Then, 
imaging conditions in the second exposure are determined to 

20 satisfy the following formula; 

AVi + TV X - SVi + 2 <; AV 2 + TV 2 - SV 2 . 

SVi, AVi, and TV X represent each APEX value of a 
photographic sensitivity , an aperture value, and a shutter 
speed in a first exposure, and SV 2 , AV 2 , and TV 2 represent each 
25 APEX value of the photographic sensitivity, the aperture value, 
and the shutter speed in the second exposure. 

White balance of the image obtained in the first exposure 
is adjusted by using a parameter according to available light. 
White balance of the image obtained in the second exposure is 
30 adjusted by using a parameter according to flashlight. Density 
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of a composite image obtained by synthesizing the images in the 
first and the second exposures is corrected such that the density 
of the main subject is properly corrected. 

In a preferable embodiment, the second shutter speed is 
5 equal to or less than 1/500 sec. The upper limit of the first 
photographic sensitivity is determined within a range from ISO 
640 to ISO 1600. It is preferable to determine the imaging 
conditions to satisfy the following formulae; 
AVi + TVi - SVl + 5 «s 6 
10 AV 2 + TV 2 - SV 2 + 5 2> 10. 

The photographic sensitivity in the second exposure is 
preferably determined such that the measured subject distance 
remains within the flashlight effective distance. In that case, 
when the following formula is not satisfied, the photographic 
15 sensitivity in the second exposure is decreased to satisfy the 
formula; 

AVi + TVi - SVi + 2 < AV 2 + TV 2 - SV 2 . 

According to the present invention, exposure parameters 
in the first exposure and those in the second exposure are 
20 optimized respectively. Since the main subject is not 
influenced by available light in the flash photography, it 
becomes possible to obtain the image of the main subject with 
proper color balance. 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 
The above objects and advantages of the present invention 
will become apparent from the following detailed descriptions 
of the preferred embodiments when read in association with the 
30 accompanying drawings, which are given by way of illustration 
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only and thus do not limit the present invention. In the drawings , 
the same reference numerals designate like or corresponding 
parts throughout the several views, and wherein: 

Fig. 1 is a block diagram illustrating the structure of a 
5 digital still camera; 

Fig. 2 is a flow chart of an imaging process in a flashlight 
photography mode; 

Fig. _3 is a flow chart of the process to determine an aperture 
value, a shutter speed, and a photographic sensitivity for a 
10 first exposure; 

Fig. 4 is a flow chart of the process to determine the 
aperture value, the shutter speed, and the photographic 
sensitivity for a second exposure; 

Fig. 5 is a time chart of the operation of an electronic 
15 shutter, a shutter blade, and a flash device; 

Fig. 6 is a table showing set values of the photographic 
sensitivity, the aperture value, and the shutter speed; and 

Fig. 7 is a table showing the relationship between a subject 
distance, the photographic sensitivity, and a light value for 
20 the second exposure. 



DETAILED DESCRIPTION OF THE EMBODIMENTS 
Referring to Fig.l, a digital still camera comprises a 
25 photometric device 33, a system controller 2 as exposure 
determining means, a WB (White Balance) circuit 10, a data 
processing circuit 11, a flashlight emission circuit 23, and 
a distance measuring circuit 21. The system controller 2 
controls each circuit of the digital still camera in response 
30 to an operation signal input from an input section 3. The input 
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section 3 is constituted of various operation members such as 
a release button and a mode selection member. A ROM 2a, connected 
to the system controller 2, stores a program and parameters for 
carrying out various sequences including a photographic 
5 sequence particular to this invention. The ROM 2a stores other 
data, such as white balance adjustment values for various light 
sources. A RAM 2b, connected to the system controller 2, is 
utilized, as a work memory for temporarily memorizing data 
necessary for carrying out the photographic sequence. 

10 In a photography mode, a user can select either a normal 

photography mode without flashlight or a flashlight photography 
mode with flashlight by operating the input section 3. In the 
normal photography mode, an exposure is carried out in a single 
photography sequence in response to a depression of a release 

15 button in the same manner as a conventional digital still camera. 
In the flashlight photography mode, two exposures (hereinafter 
referred to as a first exposure and a second exposure) are 
carried out in a single photography sequence. In the flashlight 
photography mode, images obtained by the first and the second 

20 exposures are synthesized to create one taken image. 

A CCD image sensor 5 is disposed behind a taking lens 4. 
A driver 6 of the CCD image sensor 5 controls the electrical 
charge time (the shutter speed of the electric shutter), the 
operation to transfer the charge in each pixel, and the like. 

25 Thereby, the CCD image sensor 5 outputs an electrical imaging 
signal which was converted from an optical object image. 

In a photoreceptor surface of a CCD image sensor 5, plural 
color filters of R, G, and B are arranged in a matrix pattern. 
After amplification to a suitable level by an amplifier 8, the 

30^ imaging signal including components of R, G, and B is converted 
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to image data of red, green, and blue by an A/D converter 9. 
The sensitivity of a digital still camera is determined by the 
gain of the amplifier 8 that is set by the system controller 
2 . 

5 The WB (White Balance) circuit 10 is constituted of a 

multiplier and light -source judgment device. The multiplier 
sets one of three colors (red, green, and blue) as the standard 
color. .Then, the multiplier increases or decreases the 
gradation values of other two colors based on the gradation value 
10 of the standard color and the white balance adjustment value. 

The light -source judgment device determines the type of the 

i 

light source of available light from image data of each color. 
White balance adjustment values for the flashlight and various 
kinds of available light are previously stored in the ROM 2a 
15 in the manufacture. The white balance adjustment value in the 
ROM 2a is read and set in the WB circuit 10 by the system 
controller 2 . 

Except for the second exposure in the flashlight 
photography mode, the WB circuit 10 adjusts the white balance 

20 of the image by so-called auto white balance function. The light 
source judgment device determines the type of the light source. 
Then, the white balance adjustment value is set in the multiplier 
based on the type of the light source. Thus, the WB circuit 10 
can adjust the white balance in accordance with the type of the 

25 light source in taking moving images for framing operation, in 
the normal photography mode or in taking the first exposure in 
the flashlight photography mode. 

In the second exposure in the flashlight photography mode , 
the system controller 2 sets the white balance adjustment value 

30 for the flashlight. Each multiplier outputs a value obtained 
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by multiplying the gradation values of two colors by the white 
balance adjustment value set in the multiplier, so that the white 
balance is appropriately corrected for flash photography. 

The white balance may be adjusted by increasing or 
5 decreasing the analog signal level instead of adjusting the 
gradation value in image data. In that case, each analog signal 
of R, G, and B, is generated from the image signal. White Balance 
is adjusted by increasing or decreasing the gains to amplify 
analog signals of two colors based on the white balance 

10 adjustment value. 

Image data from the WB circuit 10 is sent to the data 
processing circuit 11. The data processing circuit 11 carries 
out normal image processes such as gamma correction, sharpness 
correction, color correction, and image compression process to 

15 compress image data. Further, in the flashlight photography 
mode, a synthesize process and a digital gain process are carried 
out . 

The synthesize process is carried out by simply adding 
each image data obtained by first and second exposures. When 
20 the main subject is overexposed by available light and the 
flashlight, the density of the main subject is properly 
corrected by the digital gain process. 

In the normal photography mode, image compression is 
carried out after the normal image process. In the flashlight 
25 photography mode, the image compression is carried out after 
the synthesize process , the digital gain process , and the normal 
image process. 

A buffer memory 12 is connected to the data processing 
circuit 11. In the flashlight photography mode, image data of 
30 first and second exposure is written in the buffer memory 12. 
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In the synthesis process, image data in the buffer memory 12 
is read by the image processing circuit 11. 

An LCD 14 functions as an electronic viewfinder for 
displaying the full-color subject image, taken by the CCD image 
5 sensor 5 through the taking lens 4, in real time manner. In 
addition, the LCD 14 is used for displaying the photographed 
image. Under the photography mode , the CCD image sensor 5 takes 
the subject images continuously to obtain image data. After 
image processing in the data processing circuit 11, image data 

10 is sent to the LCD driver 15 sequentially. Thereby, moving 
subject image is displayed in the LCD 14. 

A memory card 16 as a recording medium for recording the 
images is loaded in the digital still camera. When image data 
is compressed in the image processing circuit 11, an interface 

15 circuit 17 stores compressed image data in the memory card 16. 
In a reproduction mode, a user can operate the input section 
3 to choose an image in the memory card 16. 

Image data corresponding to the selected image is read 
from the memory card 16 through the interface circuit 17. After 

20 image data is decompressed in the data processing circuit 11, 
decompressed image data is sent to the CCD driver 15. Thereby, 
image stored in the memory card 16 is displayed in the LCD 14 
as a still image. 

A distance-measuring circuit 21 measures a subject 

25 distance of the main subject, and sends subject distance data 
to the system controller 2. The system controller 2 actuates 
a focus drive circuit 22 based on subject distance data to focus 
on the main subject by moving a focusing lens 4a included in 
the taking lens 4 back and forth. Subject distance data is also 
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used for determining the photographic sensitivity under the 
flashlight photography mode. 

A passive autofocusing system or an active autofocusing 
system may be used for the distance-measuring circuit 21. In 
5 adopting the passive autofocusing system, it is preferable to 
incorporate a function for emitting illumination light, so that 
the distance-measuring circuit 21 can obtain subject distance 
information even when the subject brightness is low. In focusing 
the taking lens 4 by phase difference detecting method or 

10 contrast detection method, for example, it is possible to obtain 
the subject distance by detecting a focal position of the taking 
lens 4 by use of an encoder. 

An emission circuit 23, an Xe tube 24, a light -control 
sensor 25, a light-control circuit 26 constitutes a flash device 

15 with the automatic light amount control function. The emission 
circuit 23 emits the Xe tube 24 at the second exposure in the 
flashlight photography mode. Thereby, the flashlight 
discharged from the Xe tube 24 illuminates the subject. The 
light-control sensor 25 receives the flashlight reflected from 

20 the subject, and the received light amount is integrated in the 
light-control circuit 26. The light-control circuit 26 stops 
light emission in the Xe tube 24 when the integrated value of 
the received light amount reaches a flashlight completion value. 
The flashlight completion value is determined by the system 

25 controller 2 based on the aperture value and the photographic 
sensitivity used for the second exposure, and is set in the 
light-control circuit 26 . 

In the taking lens 4 are incorporated an aperture blade 
27 and a shutter blade 28. The aperture blade 27 and the shutter 

30 blade 28 are driven respectively by an aperture drive circuit 



31 and a shutter drive circuit 32 which are controlled by the 
system controller 2. The photometric device 33 detects subject 
brightness from the level of the image signal output from the 
CCD image sensor 5, and sends subject brightness data to the 
5 system controller 2. Subject brightness data is used to 
determine the photographic sensitivity, the shutter speed, and 
the aperture value. In the normal photography mode, the system 
controller 2 determines the photographic sensitivity, the 
shutter speed and the aperture value so as to make an appropriate 

10 subject brightness. 

The first exposure in the flashlight photography mode is 
carried out by available light. An object of the first exposure 
is to describe the background with correct brightness. 
Accordingly, in the first exposure, a correct combination of 

15 the photographic sensitivity, the aperture value, and the 
shutter speed is determined by the exposure decision circuit 
40 according to background brightness. Subject brightness 
measured by the photometric device 3 3 is used as background 
brightness. Note that background brightness includes 

20 brightness of the main subject in a strict sense, since subject 
brightness data is used in the first exposure. 

The combination of the photographic sensitivity, the 
aperture value, and the shutter speed for the first exposure 
may be determined in various methods. The shutter speed is 

25 preferably determined in consideration of a camera shake. The 
photographic sensitivity is preferably determined in 
consideration of degradation in image quality in response to 
increase in the sensitivity. Namely, in the first exposure, it 
is preferable to set the lower limit of the shutter speed to 

30 prevent the camera shake caused by low shutter speed. The 
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v commonly used shutter speed, such as 1/30 sec. , 1/60 sec. , can 
be used as the lower limit of the shutter speed. It is preferable 
to determine in consideration of the focal distance of the taking 
lens. Further, it is preferable to set an upper limit of the 
5 photographic sensitivity in order to prevent degradation of the 
image quality in response to the increase in the photographic 
sensitivity (the gain in amplifier 8). The optimum value for 
the upper limit of the photographic sensitivity depends on the 
CCD image sensor used for the photography. It is preferable to 

10 set the photographic sensitivity at ISO 640 or more in the 
present invention. In this example, the lower limit of the 
shutter speed is set at 1/30 sec, and the upper limit of the 
photographic sensitivity is set at ISO 1600. 

As mentioned above, the object of the present invention 

15 is to describe the background with proper brightness. 
Accordingly, it is preferable that the digital camera has 
sufficient system sensitivity in various conceivable 
photographed scenes. The system sensitivity (LV min ) obtained by 
the following formula (1) is preferably 6 or below, more 

20 preferably 5 or below, since the typical artificial 
illumination is 5 to 6 [EV] or over at ISO 100. 

LV min = AV min + TV min - SV max +5 ...(1) 

25 In the above formula (1), AV rain is a minimum possible 

aperture value F by APEX value. TV min is the lowest shutter speed 
by APEX value that can prevent the camera shake. SV roax is the 
upper limit of the photographic sensitivity by APEX value, set 
as above. Further, the LV value is used for representing the 

30 system sensitivity in the left side of the formula (1). This 
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LV corresponds to BV by APEX value. The LV is larger than the 
BV by 5 since the SV at ISO 100 is set to be n 0". In the right 
side of the above formula (1), the APEX value (SV max ) is 5 at 
ISO 100. Accordingly, the LV is obtained by adding 5 to n AV min 
5 + TV min - SV max ". 

The second exposure begins right after the CCD image 
sensor 5 starts to transfer the pixel charges obtained in the 
first exposure. The object of the second exposure is to eliminate 
the effect of available light as much as possible for describing 

10 the main subject with the flashlight. The exposure decision 
circuit 40 calculates the photographic sensitivity such that 
the main subject is properly exposed by the flashlight. The 
condition for eliminating the effect of available light is given 
priority in the calculation. 

15 In order to eliminate the effect of available light as 

much as possible in the second exposure, it is necessary to make 
LV 2 obtained by the formula (3) sufficiently large in comparison 
with LVi to satisfy the formula (4). 

20 LVi = AVi + TVi - SVx + 5 ...(2) 

LV 2 = AV 2 + TV 2 - SV 2 + 5 ...(3) 
LV X + 2 < LV 2 ...(4) 

AVi f TVi, and SVi in formula (2) represent APEX values for 
25 the aperture value, the shutter speed, and the photographic 
sensitivity for the first exposure. AV 2 , TV 2 , and SV 2 in formula 
(3) represent APEX values for the aperture value, the shutter 
speed, and the photographic sensitivity for the second exposure. 
Further, LVi represents proper background brightness in the 
30 first exposure. On the other hand, LV 2 represents the proper 
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brightness of the main subject in the second exposure. The 
formula (4) signifies that the exposure value in the second 
exposure is controlled such that the brightness of the main 
subject becomes underexposure by 2EV or more compared to the 
5 background brightness. Thereby, the effect of available light 
to the main subject is eliminated in the second exposure. 

By applying the high shutter speed, exposure amount of 
available light can be reduced without changing the exposure 
amount of the flashlight. Therefore, it is preferable to apply 

10 as high shutter speed as possible for the second exposure. The 
preferable shutter speed is 1/500 sec. or faster, more 
preferably 1/1000 sec. or faster. Note that the digital camera 
has to complete emitting the flashlight while the shutter is 
open in the second exposure. Further, since the object of the 

15 second exposure is to describe the main subject , it is preferable 
to photograph as high image quality as possible. Thus, it is 
preferable to carry out the second exposure in a low sensitivity 
which is superior in S/N ratio. 

In this embodiment, the shutter speed in the second 

20 exposure is fixed at 1/1000 sec. The aperture value in the second 
exposure is the same as that in the first exposure. The 
photographic sensitivity is set to obtain proper exposure 
amount of the subject at the subject distance, measured prior 
to photography, by use of the flashlight. That is, the 

25 photographic sensitivity is temporarily determined such that 
the subject distance is equal to or less than the effective 
distance obtained by dividing the guide number by the aperture 
value. Then the system controller 2 checks if the photographic 
sensitivity satisfies the formula (4). If the formula (4) is 

30 satisfied, it is set as that in the second exposure. When the 



formula (4) is not satisfied, the photographic sensitivity 
decreases gradually until it satisfies the formula (4). Thus, 
the photographic sensitivity for the second exposure is 
determined. The aperture value for the second exposure may 
5 differ from that of the first exposure. It is also possible to 
apply full aperture . 

Further, in the environment of indoor lighting with the 
LVi of 6 or less, the taken image is easily affected by available 
light. Therefore, LV 2 is preferably as large as possible, more 

10 preferably 10 or more. 

The first exposure is carried out by use of an electronic 
shutter of the CCD image sensor 5. On the other hand, the 
electronic shutter and the shutter blade 28 of the CCD image 
sensor 5 are used for the second exposure. Since the shutter 

15 blade 28 does not move between the first and the second exposures , 
it is possible to shorten the interval between the first exposure 
and the second exposure and the photographic sequence. Moreover, 
it is possible to decrease blur of the background and the main 
subject that is caused by double exposure. 

20 Next, the operation of the above configuration is 

described. When using the flashlight, the flashlight 
photography mode is selected, regardless of the intensity of 
the available light illuminating the background or the main 
subject. Under the photography mode, the full-color subject 

25 image taken by the CCD image sensor 5 is displayed in the LCD 
14 as moving subject image in a manner similar to conventional 
digital still camera. An image is taken after a frame is 
determined while observing the LCD 14. 

Referring to Fig. 2, when the release button is pressed, 

30 the distance-measuring circuit 21 measures the subject distance 



15 



and sends subject distance data to the system controller 2. The 
system controller 2 moves the focusing lens 4a through the focus 
drive circuit 22 based on subject distance data for focusing 
the main subject. In this embodiment, the first and the second 
5 exposures are carried out in focus of the main subject - However, 
it may also possible to focus the background in the first 
exposure, and then on the main subject in the second exposure. 

After adjusting the focus of the taking lens 4, the 
photometric device 33 examines the image signal level sent from 

10 the CCD image sensor 5. Thereby, subject brightness, which is 
the brightness of the background including the main subject, 
is measured. This information is sent to the exposure decision 
circuit 40 as subject brightness data. Based on this subject 
brightness data, the exposure decision circuit 40 determines 

15 the settings for the first exposure (the photographic 
sensitivity, the shutter speed, and the aperture value) such 
that the proper exposure amount of the background is obtained 
based on subject brightness data. 

Referring to Fig. 3, the standard sensitivity (ISO 100, 

20 for example) is initially applied in the first exposure. A 
combination of the shutter speed and the aperture value for 
obtaining the proper exposure amount at this photographic 
sensitivity is determined by predetermined sequence. When the 
determined shutter speed is lower than 1/30 sec, the 

25 photographic sensitivity is gradually increased until the 
shutter speed reaches 1/30 sec. 

It is also possible to adjust the shutter speed by changing 
the aperture value instead of changing the photographic 
sensitivity. When the subject brightness is high and the 

30 combination of the shutter speed and the aperture value may 
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exceed the controllable range, the photographic sensitivity 
decreases until the proper exposure amount within the 
permissible range is obtained. In case that the shutter speed 
remains lower than 1/30 sec. even though the photographic 
5 sensitivity has reached the upper limit (ISO 1600), the 
photographic sensitivity is set at the upper limit, an aperture 
value is set at the smallest full-aperture, and the shutter speed 
is set at the highest speed such that the proper exposure is 
obtained . 

10 After the settings for the first exposure has been 

determined as above, the exposure decision circuit 40 
determines the settings for the second exposure. In this 
embodiment, the shutter speed in the second exposure is fixed 
at 1/1000 sec. The aperture value in the second exposure is the 

15 same as that in the first exposure. The photographic sensitivity 
in the second exposure is determined based on the above shutter 
speed and the above aperture value. 

Referring to Fig. 4, the exposure decision circuit 40 
examines whether the subject distance is equal to or less than 

20 the maximum effective distance of the flashlight under the 
standard photographic sensitivity. The effective distance is 
obtained by dividing the guide number of the flashlight, which 
is in accordance with the standard sensitivity, by the aperture 
value used in the second exposure. Then, the obtained effective 

25 distance and the subject distance are compared. 

When the subject distance is not equal to or less than 
the effective distance, the photographic sensitivity is 
increased by one step, and the guide number is converted 
according to the photographic sensitivity. Then, the guide 

30 number is divided by the aperture value applied in the second 
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exposure to obtain the revised effective distance that is 
compared with the subject distance. Thus, the photographic 
sensitivity is gradually increased until the subject distance 
becomes equal to or less than the effective distance. This 
5 photographic sensitivity is regarded as a temporary 
photographic sensitivity in the second exposure. 

After the temporary photographic sensitivity is 
calculated as above, the exposure decision circuit 4 0 examines 
whether the temporary photographic sensitivity satisfies the 

10 formula (4). When it satisfies the formula (4), the temporary 
photographic sensitivity is used in the second exposure. On the 
other hand, when it does not satisfy the formula (4), the 
photographic sensitivity is decreased by one step to see if it 
satisfies the formula (4). Thus, the photographic sensitivity 

15 is gradually decreased until it satisfies the formula (4) . The 
photographic sensitivity which satisfies the formula (4) is 
used in the second exposure. 

For example, background brightness based on the 
photometric measurement is 9 LV ( 4 BV) , the photographic 

20 sensitivity in the first exposure is ISO 100, the full aperture 
is f/2.8, the shutter speed is 1/30 sec, the subject distance 
is 5 m, and the guide number is GNo.10 (ISO 100 *m) . In that case, 
the photographic sensitivity of ISO 200, which is one level 
higher, is temporarily used for setting the subject distance 

25 equal to or less than the effective distance of the flashlight 
at the full aperture of f/2.8. The effective distance is 5.05 
m at ISO 200 and f/2.8. In the above settings, LVj. = 9, and LV 2 
= 12 are obtained, so that the formula (4) is satisfied. 
Therefore, the photographic sensitivity of ISO 200 is used in 

30 the second exposure. 
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When the subject distance is 10 m, and other conditions 
are the same as above, the temporary photographic sensitivity 
is set at ISO 800 for making the subject distance equal to or 
less than the effective distance of the flashlight. Further, 
5 when the photographic sensitivity is ISO 800 and the aperture 
value is f/2.8, the effective distance is 10.1 m. However, in 
this case, the formula (4) is not satisfied, since LV 2 = 10. 
For that_reason, the photographic sensitivity is decreased in 
one step to satisfy the formula (4). As a result, ISO 400 is 

10 used in the second exposure. 

After each setting for the first and second exposures is 
determined as described above, the first exposure is carried 
out. The exposure decision circuit 40 controls the aperture 
blade 2 7 through the aperture drive circuit 31 to set the 

15 aperture value for the first exposure. Next, the gain according 
to the photographic sensitivity in the first exposure is set 
in the amplifier 8. The system controller 2 sends signals to 
the WB circuit 10 to retain the white balance adjustment value 
for the automatic white balance function. 

20 When the release button is pressed, the CCD image sensor 

5 takes the image of the subject illuminated by available light 
concurrently. The WB circuit 10 determines the type of the light 
source according to the input image data, and sends the result 
to the system controller 2. Thereby, the system controller sets 

25 the white balance adjustment value according to the available 
light. Therefore, prior to the first exposure, the adjustment 
value according to available light is retained in the white 
balance circuit 10. 

Fig. 5 is a time chart illustrating the operation of an 

30 electronic shutter of the CCD image sensor 5, the shutter blade 
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28, and emission of the flashlight. The electronic shutter of 
the CCD image sensor 5 is driven to remove unnecessary charge 
in each pixel. At that time, the shutter blade 28 is open, so 
that the photographic light is incident upon CCD image sensor 
5 5 through the taking lens 4. Thus, the first exposure is carried 
out with the predetermined first aperture value. 

When the first exposure is carried out for the 
predetermined first shutter speed, transfer pulses are input 
to transfer the stored charge in each pixel in a transfer path 

10 sequentially. Thereby, the image signal of the first exposure 
is output from the CCD image sensor 5 . 

The image signal from the CCD image sensor 5 is amplified 
in the amplifier 8, and sent to the A/D converter 9. Since the 
gain according to the photographic sensitivity in the first 

15 exposure is set in the amplifier 8, the image signal which 
corresponds to the photographic sensitivity in the first 
exposure is output from the amplifier 8. Thereafter, the image 
signal is converted to image data by the A/D converter 9. 

Image data obtained in the first exposure is sent from 

20 A/D converter 9 to the WB circuit 10 for white balance correction. 
Then, image data is written into the buffer memory 12 through 
the data processing circuit 11 . The WB circuit 10 , set to achieve 
proper white balance according to available light, carries out 
proper white balance correction to the taken background image 

25 exposed by available light as the light source in the first 
exposure. 

When the stored charge in each pixel is transferred to 
the transfer path of the CCD image sensor 5, the electronic 
shutter is driven to remove unnecessary charge in each pixel. 
30 Then, the second exposure is performed for the predetermined 



time according to the shutter speed, until the shutter blade 
28 is closed by the shutter drive circuit 32 . Thereby, the second 
exposure is carried out at the shutter speed of 1/1000 sec. and 
at the same aperture value as that in the first exposure. 
5 On the other hand, when the electronic shutter of the CCD 

image sensor 5 is driven to start the second exposure, the system 
controller 2 gives the trigger signal to the emission circuit 
2 3 to emit the flashlight through the Xe tube 24. Thereby, the 
flashlight illuminates the main subject. A part of the 

10 flashlight reflected by the main subject is incident upon the 
CCD image sensor 5 through the taking lens 4 as well as the light 
control sensor 25. Then, the received light amount in the light 
control sensor 25 is integrated in the light control circuit 
26. Prior to the second exposure, the system controller 2 

15 determines a flashlight completion level to obtain the proper 
exposure amount based on the aperture value and the photographic 
sensitivity in the second exposure. When the integrated amount 
reaches the flashlight completion level, light control circuit 
26 stops flashlight emission of the Xe tube 24. Thereby, under 

20 the determined aperture value in the second exposure, the main 
subject is exposed by the CCD image sensor 5 with the proper 
exposure amount according to the determined photographic 
sensitivity. 

When the temporary photographic sensitivity, which is 
25 calculated based on the subject distance, does not satisfy the 
formula (4), the actual photographic sensitivity is set lower 
than the temporary photographic sensitivity. In that case, the 
received light amount of the light control sensor 25 does not 
reach the emission completion level, so that the flash device 
30 emits the flashlight in full emission . Accordingly , the 
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exposure amount of the main subject becomes less than the proper 
amount . 

When the image data obtained in the first exposure is 
stored into the buffer memory 12 , the gain according to the 
5 photographic sensitivity in the second exposure is set in the 
amplifier 8. The system controller 2 reads the white balance 
adjustment value according to the flashlight from ROM 2a, and 
sets it in the WB circuit 10. Then, the system controller 2 
controls the driver 6 to transfer the charge in each pixel, so 

10 that the image signal is input from the CCD image sensor 5. The 
amplifier amplifies the image signal by the gain according to 
the photographic sensitivity in the second exposure. Thereby, 
the image signal level changes to the level to which the 
photographic sensitivity in the second exposure has been 

15 applied. 

After amplified in the amplifier 8, the image signal is 
converted to the image data by the A/D converter 9, and is input 
in the WB circuit in sequence. Since the white balance adjustment 
value for the flashlight is set in the WB circuit 10, image data 

20 is corrected such that the subject illuminated by the flashlight 
obtains the proper white balance. Thereafter, corrected image 
data is written in the buffer memory 12 through the data 
processing circuit 11. 

When image data of two frames obtained in the first and 

25 the second exposures is respectively written in the buffer 
memory 12, the data processing circuit 11 reads and adds both 
image data. Thereby, a composite image is created by 
synthesizing the images exposed in the first and the second 
exposures. The density of the composite image is corrected by 

30 a digital gain process of the data processing circuit 11. Thus, 
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the main subject obtains the proper density even if the main 
subject is overexposed due to available light. When the digital 
gain processing is completed, the composite image is subject 
to the normal image processing. Thereafter, synthesized image 
5 data of the composite image is compressed, sent to an interface 
circuit 17, and written in a memory card 16. 

As described above, the white balance of the background 
exposed by available light in the first exposure is properly 
adjusted according to the light source of available light. The 

10 second exposure is carried out with the exposure value that is 
lower by two or more steps compared to the proper exposure amount 
of the background, so that the exposure amount of the main 
subject by available light becomes very small. Therefore, even 
when the white balance of the image obtained in the second 

15 exposure is properly adjusted to the flashlight, there is no 
color fog and disagreeable color failure caused by the available 
light . 

When the available light illuminates the main subject, 
for example, in a room or outdoors during daytime, the main 

20 subject is exposed with the proper exposure amount in the first 
exposure. The main subject becomes overexposed when the 
exposure amount by the flashlight has been added. However, the 
density correction is applied to the main subject in the digital 
gain process to obtain the proper density. Accordingly, an ideal 

25 image with proper brightness and color balance both in the 
background and the main subject is obtained. 

In the above embodiment, the first exposure is carried 
out by available light, and the second exposure is carried out 
by the flashlight. However, the sequence may be carried out in 

30 the reverse order. In that case, the possibility is high that 



the exposure time by the available light is longer than the 
exposure time by the flashlight. If the subject or the 
photographer thinks that the photography is completed when they 
see the flashlight emission, the subject or the photographer 
5 moves in the next exposure to cause the camera shake or subject 
shake. Therefore, it is preferable to carry out the exposure 
by available light first , and then the exposure by the flashlight 
as described in the above embodiment. 

The combination of the photographic sensitivity, the 

10 aperture value, and the shutter speed can be determined by any 
method as long as it satisfies the above conditions. The 
photographic sensitivity, the aperture value, and the shutter 
speed can be determined previously as a program according to 
the brightness of the background and the subject distance. 

15 Fig. 6 shows an example of a program of the photographic 

sensitivity, the aperture value, and the shutter speed of the 
first and the second exposures at the subject distance of 2 m 
when the settings in the digital camera are as follows: the full 
aperture value is f/2.8, the upper limit of the shutter speed, 

20 with which a synchronization with the flashlight is possible, 
is 1/1000 sec. ; the lower limit of the shutter speed, in 
consideration of the camera shake, is 1/30 sec.; the standard 
sensitivity is ISO 100; the upper limit of the photographic 
sensitivity is ISO 1600 in the first exposure; and maximum 

25 flashlight amount is GNo . 10 . 2 ( IS0100 -m) . 

When the background brightness is LV 10, the photographic 
sensitivity of ISO 100, the aperture value of f/4, and the 
shutter speed of 1/60 sec. are set in the first exposure. As 
the background brightness becomes lower than LV 10 , the aperture 

30 value is gradually decreased from f/4.0 according to the 
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decrease in the brightness. The shutter speed is also gradually 
decreased while keeping the photographic sensitivity at ISO 
100. 

When the background brightness is LV8, the aperture value 
5 is set at full aperture of f/2.8, and the shutter speed is set 
at the lower limit of 1/30 sec. in consideration of the camera 
shake under the photographic sensitivity of ISO 100. When the 
brightness of the background becomes lower than LV 8, the 
photographic sensitivity is increased while the aperture value 

10 is kept at f/2.8 and the shutter speed is kept at 1/30 sec. 

When the brightness of the background is LV 4, the 
photographic sensitivity is set at ISO 1600, the aperture value 
is set at f/2.8, and the shutter speed is set at 1/30 sec. Even 
if the brightness of the background becomes lower than LV 4, 

15 this combination of the photographic sensitivity, the aperture 
value, and the shutter speed, is used. 

Thus, the combination of the photographic sensitivity, 
the shutter speed, and the aperture value, is determined in order 
to obtain the proper exposure amount within the range of LV10 

20 - LV4 . When the brightness of the background is higher than LV 
10, the flashlight photography mode automatically shifts to the 
normal photography mode to carry out normal photography. 

In the second exposure, for example, when the subject 
distance is 2m, the photographic sensitivity is fixed at ISO 

25 100 and the shutter speed is fixed at 1/1000 sec. The same 
aperture value as that in the first exposure is used in the second 
exposure. Thereby, the second exposure is carried out by 
applying the photographic sensitivity, the aperture value, and 
the shutter speed that achieve underexposure state by 2EV or 

30 more compared to the proper exposure amount of the background. 
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The subject distance is set to be equal to or less than the 
effective distance of the flashlight. Thus, the combination of 
the photographic sensitivity, aperture value, and the shutter 
speed is determined such that the main subject is exposed with 
5 the proper exposure amount by the flashlight . 

As for other subject distance, the same combination of 
the aperture value and the shutter speed, that are used at the 
subject distance of 2m, is applied. In other words , the aperture 
value is determined to be the same as that in the first exposure. 

10 The shutter speed is determined at 1/1000 sec. Under this 
condition, the photographic sensitivity is determined to make 
the subject distance equal to or less than the effective distance 
of the flashlight. Thus, the photographic conditions in the 
second exposure are programmed. 

15 When the brightness of the background is LV8 , for example, 

as shown in Fig. 7, the photographic sensitivity is determined 
to be ISO 100 if the subject distance is 2m or 3m. However, when 
the subject distance is 5m, the photographic sensitivity is 
determined to be ISO 200, because the subject distance does not 

20 become equal to or less than the effective distance of the 
flashlight with the aperture value of f /2.8 and the photographic 
sensitivity of ISO 100. The subject distance becomes equal to 
or less than the effective distance of the flashlight when the 
subject distance is 10m and the photographic sensitivity is ISO 

25 800, and when the subject distance is 20m and the photographic 
sensitivity is ISO 1600. However, in such settings, the 
underexposure value by 2EV or more compared to the background 
brightness cannot be achieved in the second exposure. Therefore, 
the photographic sensitivity in the second exposure is 

30 determined to be ISO 400. 
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Although the present invention has been described with 
respect to the preferred embodiment, the present invention is 
not to be limited to the above embodiment, but, on the contrary, 
various modifications will be possible to those skilled in the 
art without departing from the scope of claims appended hereto- 



